Stationary solution approximation using a memory-efficient perfect sampling technique
نویسندگان
چکیده
The analytical solution of large Markovian models is one of the major challenges in performance evaluation. Structured formalisms provide a modular description to tackle state space explosion by presenting memory-efficient solutions based on tensor algebra and specific software tools implement such solutions using iterative methods. However, even these numerical methods become unsuitable when massively large models are considered, i.e., models with more than 100 million states. To deal with such classes of models is possible to find approximations of the stationary solution using simulation of long-run trajectories with perfect sampling methods. The use of these methods prevents usual simulation problems such as initial state setup and burn-in time. Unfortunately, the number of produced samples to establish statistically significant solution remains an open problem. This paper analyzes the sampling process in its extent, proposing a memory-efficient stopping criteria based on a numerical tolerance of the measures of interest. Moreover, we present some memory cost estimations for a classical Markovian model in order to demonstrate the gains of the proposed method.
منابع مشابه
A Perfect Sampling Algorithm of Random Walks with Forbidden Arcs
I will present a result obtained with Bruno Gaujal and Florence Perronin on simulation of grid Markov chain. Random walk are frequently used to model behavior of systems or complex randomized algorithm. one often needs to be able to compute or sample the stationary distribution. The problem we consider here is sampling the stationary distribution of a random walk on a multidimensional grid of g...
متن کاملAn efficient analytical solution for nonlinear vibrations of a parametrically excited beam
An efficient and accurate analytical solution is provided using the homotopy-Pade technique for the nonlinear vibration of parametrically excited cantilever beams. The model is based on the Euler-Bernoulli assumption and includes third order nonlinear terms arisen from the inertial and curvature nonlinearities. The Galerkin’s method is used to convert the equation of motion to a nonlinear ordin...
متن کاملPerfect sampling without a lifetime commitment
Generating perfect samples from distributions using Markov chains has a wide range of applications , from statistical physics to approximation algorithms. In perfect sampling algorithms, a sample is drawn exactly from the stationary distribution of a chain, as opposed to methods that run the chain \for a long time" and create samples drawn from a distribution that is close to the stationary dis...
متن کاملPerfect Sampling of Markov Chains with Piecewise Homogeneous Events
Perfect sampling is a technique that uses coupling arguments to provide a sample from the stationary distribution of a Markov chain in a finite time without ever computing the distribution. This technique is very efficient if all the events in the system have monotonicity property. However, in the general (non-monotone) case, this technique needs to consider the whole state space, which limits ...
متن کاملAccelerated Gibbs sampling of normal distributions using matrix splittings and polynomials
Standard Gibbs sampling applied to a multivariate normal distribution with a specified precision matrix is equivalent in fundamental ways to the Gauss–Seidel iterative solution of linear equations in the precision matrix. Specifically, the iteration operators, the conditions under which convergence occurs, and geometric convergence factors (and rates) are identical. These results hold for arbit...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011